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Introduction 

CMMI  Adoption 

*  CMMI  Appraisal  Results 

*  CMMI  Adoption  Trends 

CMMI  Current  Activities 


•  CMMI-AM  (CMMI  Acquisition  Module) 

•  CMMI  Product  Suite  vl.2  Update 
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Current  Appraisal  Synopsis 

Based  on  SCAMPI  vl.1  Class  A  appraisals 
conducted  since  the  April  2002  release  through 
August  2004 

•  424  appraisals 

•  385  organizations 

*  206  participating  companies 

*  33  reappraised  organizations 

•  1,704  projects 

*  54.8%  Non-USA  organizations 


For  more  information  go  to:  http://www.sei.cmu.edu/sema/profile_cmmi.html 
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Reporting  Organizational  Types 


CMA9I 


Commercial/ln-house 


Contractor  for 
Military/Government 


Military/Government 

Agency 


70% 


%  of  Organizations 

Blue  H  385  organizations  2004 
Red  ■  91  organizations  2003 
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Organizations  Type 

Based  on  Primary  Standard  Industrial  Classification  (SIC)  Code 


Wholesale  Trade 
1.1% 


Retail  Trade 
0.6% 


Business  Services 
36.5% 


Engineering  &  Management 
Services 
15.7% 


Services,  Nec 
1.7% 


Transportation, 

Communication,  Electric,  Gas 
and  Sanitary  Services 
1.7% 

Finance,  Insurance  and  Real 
Estate 
8.4% 


Public  Administration 
/ —  (Including  Defense) 
13.5% 

Fabricated  Metal  Products 
0.6% 

Primary  Metal  Industries 
0.6% 


Industrial  Machinery  And 
Equipment 
1.1% 

Transportation  Equipment 
5.1% 


Electronic  &  Other  Electric 
Equipment 
5.6% 


Health  Services 
1.1% 


Instruments  And  Related 
Products 
6.7% 


Based  on  178  organizations  reporting  SIC  code.  For  more  information  visit:  http://www.osha.gov/oshstats/sicser.html 
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Based  on  the  total  number  of  employees  within  the  area  of  the  organization  that  was  appraised 


1001  to  2000 
9.6% 


2000+ 

3.7% 


501  to  1000 
9.0% 


301  to  500 
11.2% 


201  to  300 
11.2% 


25  or  fewer 
10.4% 


26  to  50 
11.4% 


51  to  75 
9.8% 


76  to  100 
8.2% 


Based  on  376  organizations  reporting  size  data 
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Disciplines  Selected  for  Appraisals 

300  n 


SE  =  System  Engineering 
SW  =  Software  Engineering 
IPPD=  Integrated  Product  and 


Process  Development 
SS  =  Supplier  Sourcing 


SBSW  SW  SBSW/IPPCVSS  SBSW/SS  SE  SBSW/IPPD  SW/IPPD  SW/SS  SBSS  SBIPPDfSS 


Based  on  424  appraisals  reporting  coverage 
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11.7% 


4.7% 


31.7% 


25.2% 


Not  Given  Initial  Managed 

Based  on  most  recent  appraisal  of  385  organizations 


Defined 


4.7% 


CMMI 


Maturity  Profile 

by  All  Reporting  Organizations 


22.1% 


Quantitatively  Optimizing 

Managed 
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Countries  where  Appraisals  have  been 
Performed  and  Reported  to  the  SEI 


Argentina  Australia 

Colombia  Denmark 

Israel  Japan 

Singapore  South  Africa 

United  Kingdom  United  States 


Belarus  Brazil 

Finland  France 

Korea,  Republic  of  Malaysia 
Spain  Sweden 


Canada  Chile 

Germany  Hong  Kong 

New  Zealand  Philippines 

Switzerland  Taiwan 


China 

India 

Russia 

Thailand 


Red  country  name:  New  additions  with  this  reporting  since  Nov.  2003 
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100%  -r 

90%  - 

80% 
70%  + 
60% 
50%  + 


Maturity  Profiles  by  All  Reporting 
USA  and  Non-USA  Organizations 


Not  Given 


Initial 


Managed 


Defined 


■  USA  ■  Non-USA 

Based  on  174  U.S.  organizations  and  211  Non-USA  organizations 


26.1% 


Quantitatively  Optimizing 
Managed 
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Number  of  Appraisals  Conducted  by  Year 


Reported  as  of  1  November  2004 


□  SPA  ■  SEI  CBAIPI  □  SCAMPI  vX Class  A 
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Number  of  SCAMPI  vl.x  Appraisals  Conducted 
by  Year  by  Model  Representation* 

Reported  as  of  1  November  2004 

*Where  Representation  is  reported 
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Number  of  SCAMPI  vl.1  Appraisals 

Conducted  by  Month 

Reported  as  of  1  November  2004 
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Appraisal  Results  Summary 

424  appraisals  have  been  reported  to  the  SEI  in  27 
months 

Commercial  organization  percent  is  increasing 
compared  to  the  government  contractor  community 

*  higher  percentage  of  the  commercial  organizations 
are  outside  of  the  U.S.A. 

*  higher  percentage  of  the  government  contractors 
are  located  in  the  U.S.A. 

Of  U.S.  organizations,  the  services  and  manufacturing 
industries  reported  most  appraisals 

Compared  to  the  early  reports  of  the  SW-CMM 
maturity  profile,  the  early  data  reflects  a  relatively 
more  mature  CMMI®  profile 
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CMMI  Transition  Status, 

Reported  as  of  30  September  2004 


Training 

Introduction  to  CMMI  -  24,091  trained 
Intermediate  CMMI  -  1,166  trained 
Introduction  to  CMMI  Instructors  -  349  trained 
SCAMPI  Lead  Appraisers  -  470  trained 

Authorized 

Introduction  to  CMMI  VI. 1  Instructors  -  219 
SCAMPI  VI. 1  Lead  Appraisers  -  344 
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CMMI  Transition  Status2 

Reported  as  of  30  September  2004 

SEI  (Transition)  Partners 
123  Introduction  to  CMMI  Partners 
105  commercial  offerors 
15  internal-use  only 

3  government-use  only 

172  SCAMPI  Appraiser  Services  Partners 
158  commercial  offerors 
10  internal-use  only 

4  government-use  only 


For  more  info  go  to:  http://www.sei.cmu.edu/partners 
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Number  of  Lead  Appraisers  Authorized 

(Cumulative)  Reported  as  of  31  October  2004 


500 

450 

400 

350 

300 

250 

200 

150 

100 

50 

0 


n 


LJ 


i  i  i  i  i  i  i  i  i  r 

1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  YTD 

2004 


□  Lead  Evaluators 
(SCE) 

■  Lead  Assessors 
(CBA IPI) 

□  Lead  Appraisers 
(SCAMPI) 


10-31-04 
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Intro  to  the  CMM  and  CMMI  Attendees 

(Cumulative)  Reported  as  of  30  September  2004 


1995  1996  1997  1998  1999  200#  2001  2002  2003  YTD 

2004 


□  CMM  Intro 

■  CMMI  Intro 

■  CMMI  Intermediate 

9-30-04 
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CMMI  Adoption  Trends:  Website  Visits 

There  were  392  organizations  that  visited  the  CMMI 
website  more  than  200  times  during  September 
2004 

*  56  defense  contractors 

*  9  DoD  activities 

*  28  government  agencies 

*  253  commercial  companies 

*  46  universities 
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CMMI  Adoption  Trends:  Website  Visits 


Total  number  of  page  views  per  month 
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Performance  Results  Summary 

Reported  as  of  12  November  2004 

23  organizations  reported  credible  quantitative  evidence  in 
conference  presentations  and  via  direct  communication 
with  the  SEI 

•  initial  CMMI  benefits  and  ROI  report,  October  2003 

•  CMMI  Technology  Conference,  November  2003 

•  SEPG  and  European  SEPG,  March  and  June  2004 

•  confidential  communication  with  SEI 

14  of  these  organizations  reported  results  from  which  we 
can  show  percent  change  over  time 

Future  results  will  come  from 

•  externally  conducted  case  studies 

•  collaborative  case  studies 

•  community  benchmarking 
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Performance  Results  Summary, 

Reported  as  of  12  November  2004 


Improvements 

High 

Low 

Median 

#  of 
data 
points 

Cost 

83% 

5% 

26% 

8 

Schedule 

90% 

15% 

55% 

10 

Productivity 

75% 

11% 

28% 

4 

Quality 

72% 

33% 

47% 

6 

Customer  Satisfaction 

55% 

10% 

33% 

3 

Return  on  Investment 

13  :  1 

2  :  1 

3.8  :  1 

4 
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CMMI  Acquisition  Module  (CMMI-AM) 

Draft  released  February  2004 

Focuses  on  effective  acquisition  activities  and 
practices  that  are  implemented  by  first-level 
acquisition  projects  (e.g.,  System  Project 
Office/Program  Manager) 

Acquisition  practices  drawn  and  summarized  from 
existing  sources  of  best  practices 

*  Software  Acquisition  Capability  Maturity  Model 
(SA-CMM) 

*  Capability  Maturity  Model  Integration  (CMMI) 

•  FAA  Integrated  Capability  Maturity  Model  (iCMM) 

•  Section  804 

Intended  to  be  used  in  conjunction  with  the  CMMI 
as  an  acquisition  “lens”  for  interpreting  the  CMMI  in 
acquisition  environments 
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CMMI 


•  Project  Planning 

•  Project  Monitor  and 
Control 

•  Integrated  Project 
Management 

•  Risk  Management 

•  Integrated  Teaming 

•  Solicitation  and 
Contract  Monitoring 


•  Requirements 
Management 

•  Requirements 
Development 

•  Verification 

•  Validation 
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•  Configuration 
Management 

•  Process  and  Product 
Quality  Assurance 

•  Measurement  and 
Analysis 

•  Decision  Analysis  and 
Resolution 

•  Transition  to 
Operations  and 
Support 

•  Organizational 
Environment  for 
Integration 
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CMMI-AM  Phase  III  Progress 

*  pilot  program  assessments  complete. 

-  8  pilots  conducted  by  OSD 

*  draft  report  prepared  by  OUSD;  reviewed  by 
assessment  team  members  who  had 
participated  on  more  than  one  assessment  (10 
people) 

*  report,  including  recommendations,  delivered 
to  OUSD  management  and  CMMI-AM  authors 
on  October  8th 

*  report,  including  recommendations  for  CMMI- 
AM  Update,  to  be  presented  to  Steering  Group 
and  Sponsor  at  November  meeting 
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CMMI-AM  Pilot  Results:  Positive 

•  no  show  stoppers  to  prevent  immediate  use 
when  accompanied  with  training 

•  applicable  to  all  life  cycle  phases, 
applications,  and  program  size  within  pilot 
study  with  appropriate  interpretation 

•  more  robust  process  areas:  Project  Planning, 
Project  Monitoring  and  Control,  Risk 
Management,  Requirements  Management,  and 
Requirements  Development 
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CMMI  Version  1.2  Plan 

Prime  Rule:  Maintain  CMMI  Stability 
*  No  Major  Changes  in  vl.2  that  will  affect 
previous  appraisals 

New  Framework  Architecture 

New  Content  Opportunities 

Single  Course  Training 

Model  Simplifications 
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CMMI  vl.2  Architecture 

*  Revised  (internal)  Architecture  will  allow  better 
accommodation  of  content 

-  In  CMMI  vl.1,  “IPPD”  and  “SS”  are  not 
“disciplines”  in  the  same  sense  as  SE  and 
SW 

-  Defined  as  CMMI-SE/SW/IPPD/SS  because 
of  architecture  constraints 

-  VI. 2  Architecture  will  allow  proper  treatment 
of  focus  elements  such  as  IPPD  and  SS,  and 
the  easy  addition  of  other  elements  such  as 
safety  or  security,  for  example 

-  Existing  PAs  can  now  be  changed  when 
adding  such  additional  focus  elements 

-  New  designation:  CMMI-SE/SW+IPPD+SS 
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Additional  Content  Opportunities 

New  vl.2  architecture  allows  additional  constructs 

*  new  framework  will  support  Services  and  Operations 
content,  such  as  maintenance/support,  help  desk,  etc 
via  new  “services  constellation”  of  CMMI 

-  proposal  for  “Services”  Constellation  already  received  by 
CMMI  Steering  Group 

*  allows  present  “development  constellation”  to  be 

better  structured 

-  i.e.  CMMI-SE/SW+IPPD+SS 

-  allows  for  additional  focus  elements  such  as  safety  or 
security 

-  NOTE  these  are  NOT  disciplines  in  the  sense  of  SE 
and  SW 

*  additional  content  will  follow  release  of  vl.2 


©  2004  by  Carnegie  Mellon  University 


November  2004 


Page  29 


Carnegie  Mellon  University 

Software  Engineering  Institute 


CMM f 

“Single  Book,  Single  Course”  Strategy 

CMMI  vl.2  will  consolidate  both  staged  and 
continuous  representations 

single  course  for  “Intro  to  CMMI”  has  been  created 

-  first  public  offering  here  last  week 

-  1/3  of  “staged”  proponents  converted  to 
“continuous” 

-  new  instructors  will  only  be  trained  in  single  course 

-  existing  instructors  will  receive  upgrade  training 

-  staged  and  continuous  courses  will  be  available  until 
planned  upgrade  training  is  complete 

SCAMPI  refinements  will  complement  the  strategy 
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Model  Simplifications 

To  address  size  and  complexity 

*  “single  book”  approach  to  model 

-  not  eliminating  staged  or  continuous,  just  packaging  better 

*  eliminate  concept  of  advanced  practices. 

*  eliminate  concept  of  common  features. 

*  improve  model-method  interactions  for  artifacts. 

*  looked  at  combining  select  PAs  such  as  VAL  &  VER 

-  detailed  analysis  revealed  that  no  PA  combinations  had 
validity  or  merit 

To  address  hardware  design  applicability 
adding  “hardware”  amplifications  to  provide  better 
coverage  of  hardware  design  in  CMMI 

-  NOT  adding  “HW”  discipline!  Design  of  hardware  is  already 
covered  in  CMMI,  just  not  a  well  as  we  would  have  liked 
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CMMI  vl.2  Schedule 

several  thousand  change  requests  were  analyzed 
since  January  2004 

-  content,  clarifications,  errata,  etc 

development  of  Change  Packages  (CPs)  underway 

Configuration  Control  Board  (CCB)  starts  meeting 
now 

-  approve  CPs  for  development  into 
Implementation  Packages  (IPs) 

-  training  update  will  occur  to  match  model 

pilot  vl.2  in  early  FY06  (i.e.  Fall  2005) 

release  vl.2  late  FY06  (i.e.  June  2006) 

Release  date  of  “Services”  constellation  will  follow 
within  3  to  6  months 
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Summary 

CMMI  is  in  widespread  adoption 

*  more  people  CMMI-trained  in  past  2-1/2  years  than 
in  12  years  of  SW-CMM 

*  CMMI  Appraisal  results  flowing  fast  &  furious 

-  1st  USAF  site  achieved  CMMI-SE/SW  Level  5 

-  Warner  Robins  AFB,  Oct  2004 

CMMI  is  already  demonstrating  substantial  ROI  and 
measurable  benefits  to  adopting  organizations 

CMMI  vl.2  will  bring  needed,  but  gentle, 
improvements 

CMMI  vl.2  “Services”  constellation  will  provide  full 
life  cycle  and  enterprise  coverage 

http://www.sei.cmu.edu/cmmi 
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